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System and Method for Storing 
Compressed Data Onto a Storage Medium 



Inventors: Fabian W. Meier 

Francis S. Bernard 



5 Cross-Reference to Related Applications 

This application is related to commonly owned, co-pending application 
no. (to be assigned), filed on even data herewith, titled "System and Method for 
Compressing Data," attorney docket no. 1452.3070000, the full text of which is 
incorporated herein by reference as if reproduced below. 

10 Background of the Invention 

Field of the Invention 

The present invention relates generally to the storage of data and, more 
particularly, to the compression, recording and playing of video data. 

Related Art 



1 5 Compression is the process of encoding an image such that it requires less 

space for storage. There are two fundamental ways to compress image data: lossy 
compression and lossless compression. Examples of lossy compression schemes 
include JPEG and MPEG. Lossy compression can provide a very high 
compression ratio. However, during the encoding process some data will be 

20 irreversibly lost. Consequently, a lossy encoded image will have some degradation 

of visual quality when expanded. Lempel-Ziv and Welch (LZW) encoding and 
Rice encoding are two well known lossless compression algorithms. Lossless 
compression usually results in compression ratios lower than those obtained with 
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lossy compression. However, the benefit of compressing an image using a lossless 
compression scheme is that once expanded, the resulting image will be exactly as 
it was prior to being compressed. 

Traditionally, with any compression algorithm, the compression ratio is 
data dependent. Accordingly, the compression ratio cannot be predicted. 
However, in certain instances, control of the compression ratio is desired. For 
example, a video cassette recorder (VCR) tape has a constant bandwidth capacity. 
Likewise, a hard disk array has a maximum data storage capacity; therefore, when 
recording data onto either storage device, it is highly desirable to control the 
compression ratio of the data. The importance of this control is even more evident 
when one considers the recent developments in the area of high definition 
television (HDTV). 

As compared with conventional TV, HDTV signals have higher resolution 
and require more bandwidth for storage. For example, an HDTV image presented 
in 10801 format with 444 sampling and 8 bit resolution has a bandwidth of 1.5 
Gbits/s. Present VCR tapes are unable to meet such storage demands. While 
recording devices and media (e.g., tapes, ROM cartridges, magnetic or optical 
disks) capable of recording HDTV images will be developed, compression will still 
be desirable, if not necessary. 

A feature of HDTV is the high quality resolution of the images produced. 
Thus, any compromising of the visual image is not desirable. As already 
mentioned, lossy compression results in diminished video quality. Likewise, as 
one considers the bandwidth constraints imposed by storage media, it is evident 
that the use of a lossless compression scheme can also create problems. Consider 
the following explanation. The compressed bit streams of image sequences 
produced by lossless compression schemes often include bandwidth peaks. 
Bandwidth peaks are the result of producing a number of successive fi-ames with 
a very low compression ratio. If the storage media, a VCR tape for example, 
lacked the capacity to store tiie bandwidth peak portions of the bit stream then the 
data would be lost. Buffering is used to avoid this scenario. Buffering, however, 
raises the potential for two additional problems: latency and buffer overflow, both 
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of which result in lost data and/or diminished visual quality. Therefore, what is 
needed is a method for compressing data, in particular, high definition television 
image data, such that the resulting bit stream bandwidth is kept relatively constant 
and the image quality is not compromised. These results allow the bit streams to 
be recorded on a storage medium and viewed without diminished visual quality. 

Summary of the Invention 

The present invention provides a system and method for recording data 
onto a storage medium such that it can be replayed to provide either a lossy 
quality or lossless quality presentation. Because there is some loss of visual 
integrity associated with a lossy presentation, this option is acceptable when the 
user intends to only preview the image or video sequence. The benefit of 
presenting a lossless quality presentation is that the decompressed image will be 
exactly the same as the original uncompressed image. 

In order to view either lossy or lossless quality presentations, the 
compressed data must first be recorded onto a storage medium. Each image of 
a video sequence is processed by an encoder. The output of the encoder is a fixed 
length primary bit stream and a variable length supplemental bit stream. The size 
of the fixed length bit stream is chosen according to the write-bandwidth of the 
storage medium. As each of the primary bit streams are received, they are 
recorded directly onto the storage medium in real time. As each of the 
supplemental bit streams are received, they are written into temporary memory in 
real time. Once all of the primary bit streams are received and subsequently 
written onto the storage medium, the supplemental bit streams will be retrieved 
from the temporary memory and written onto the storage medium. After all of the 
bit stream data has been written onto the storage medium, a user can be prompted 
as to the mode of desired playback. 

The viewing choices include either lossy quality or lossless quality. If the 
desired data presentation quality level is lossy then the primary bit stream of the 
saved compressed data is retrieved from the storage medium. The primary bit 
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stream includes variable length portions and possibly fixed length portions of 
encoded data. The primary bit stream is provided to a decoder for decoding. If 
the desired data presentation quality level is lossless, then the supplemental bit 
stream will be retrieved first. The supplemental bit stream, which includes fixed 
length and possibly variable length data, is retrieved from the storage medium and 
written into temporary memory. Once all of the supplemental bit stream data has 
been written into temporary memory then both the primary bit stream data and the 
supplemental bit stream data is input into a decoder for decompression into 
lossless data. 

Thus, the output from the decoder is either a presentation of the original 
image in lossy quality or lossless quality. The ability to choose the decoding 
quality makes this scheme a progressive image compression scheme. 

The method for image compression (i.e., producing the primary and 
supplemental bit streams) comprises the steps of dividing the image into a plurality 
of regions. For each region, a plurality of adjacent pixels corresponding to one 
color component are selected and identified as a pixel sample set. Corresponding 
pixel sample sets from the plurality of regions are associated into a group. 

For each selected pixel, a pixel value of the selected pixel is encoded to 
generate a fixed length token and a variable length token. The variable length 
tokens for each pixel value in the set are arranged to form a variable length token 
vector. Further, each of the fixed length tokens are arranged to associate each bit 
of a pixel value with corresponding bits of other pixel values within the set. A 
fixed length token vector is then formed from the corresponding bits of the 
plurality of fixed length tokens. 

For each group, a first bit stream that includes the variable length token 
vector from each of the plurality of regions is formed. A second bit stream is also 
formed. This second bit stream includes the fixed length token vectors from each 
of the plurahty of regions. Additionally, a primary bit stream of constant length 
is formed. If required, a supplemental bit stream of variable length will also be 
formed. Both the primary bit sfream and the supplemental bit sfream may include 
data from the first and second bit streams corresponding to each of the groups. 
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At a minimum, the primary bit stream will contain a portion of the variable 
length token vectors from each group. The variable length token vectors 
correspond to the more significant bits representing the compressed image or 
frame. Thus, the data in the primary bit stream is sufficient to provide a lossy 
5 quality presentation. The supplemental bit stream contains the remaining variable 

length and fixed length token vectors. By decoding the data from the 
supplemental bit stream and the primary bit stream together, a lossless quality 
presentation is obtained. 

An advantage of the encoding method of the present invention is that it 
10 allows one part of the compressed bit stream to be kept constant in size by 

sacrificing image quality. 

Another advantage is that lossless compressed image data can be recorded 
to a fixed-bandwidth storage medium in realtime. 

A further advantage is that the encoding and decoding processes are highly 
15 parallelizable which is very desirable for software or hardware implementation. 

Another advantage is that when the best quality image is desired, all the 
data that one needs to decompress an image and present it in original (i.e., 
lossless) quality is available. 

The foregoing and other features and advantages of the invention will be 
20 apparent from the following, more particular description of a preferred 

embodiment of the invention, as illustrated in the accompanying drawings. 

Brief Description of the Figures 

FIG. 1 illustrates how progressive lossless compressed data is organized 
onto a storage medium according to an embodiment of the present invention. 
25 FIG. 2 is a block diagram illustrating a system for recording progressive 

lossless compressed data onto a storage medium according to an embodiment of 
the present invention. 
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FIG. 3 is a block diagram illustrating a system for lossy quality playback 
of compressed data from a storage medium according to an embodiment of the 
present invention. 

FlGs.4and5 are block diagrams illustrating a system for lossless quality 
playback of compressed data from a storage medium according to an embodiment 
of the present invention. 

FIG. 6 is a flow diagram illustrating the general functionality of 
compressing data according to an embodiment of the present invention. 

FIG. 7 is a flow diagram illustrating the general functionality of performing 
prediction error calculations, mapping, and token generation for one region 
according to an embodiment of the present invention. 

FIG. 8 is a data flow diagram illustrating the processing of pixel value 
prediction error calculations and encoding of a pixel value according to an 
embodiment of the present invention. 

FIG. 9 is a flow diagram illustrating the general functionality of generating 
and packing fixed length token vectors and variable length token vectors for one 
group of regions according to an embodiment of the present invention. 

FIG. 10 is a flow diagram illustrating the general functionality of 
generating a primary bit stream and a supplemental bit stream according to an 
embodiment of the present invention. 

FIG. 1 1 is a data flow diagram illustrating an image being compressed into 
a primary bit stream and a supplemental bit stream used for both lossy and lossless 
presentation according to an embodiment of the present invention. 

FIG. 12 is a data flow diagram illustrating the reordering of fixed length 
token vectors for one group according to an embodiment of the present invention. 



SGI Reg: 15-4-1062.00 
SKGF Ref: 1452.3080000 



Detailed Description of the Preferred Embodiments 



The preferred embodiments of the invention are described with reference 
to the figures in which like reference numbers indicate Hke elements. Furthermore, 
the left most digit of each reference number indicates the number of the figure in 
which the number is first referenced. While specific configurations and 
arrangements are discussed, it should be understood that this is done for 
illustration purposes only. A person skilled in the art will recognize that other 
configurations and arrangements may be used without departuig firom the spirit 
and scope of the invention. 

The present invention provides a system and method for the compression 
and storage of data. In a preferred embodiment, the data is video frame 
information, such as HDTV (high definition television) video data. Thus, the 
preferred embodiments of the invention are described with reference to HDTV and 
video examples. It will be apparent, however, to a person skilled in the art that 
the invention can be used to compress and store a variety of different types of 
data. 

FIG. 1 provides an illustration of how compressed data can be organized 
onto a tape in accordance with an embodiment of the invention. In this example 
implementation, the compressed data is stored on a magnetic tape 1 00. However, 
a person skilled in the art will recognize that the invention can also be used with 
an optical tape, magnetic disk, optical disk, RAID (redundant array of inexpensive 
disks) device, and the like. 

Referring now to FIG. 1, header data 105 is written at the beginning of 
the tape 100. Header data 1 05 can include information aboutthe compressed data 
being recorded to tape 100. Such information can include for example, the 
starting location of supplemental bit stream portion 135. Next, the compressed 
data is written to tape 100. The compressed data includes a primary bit stream 
portion 1 30 and a supplemental bit stream portion 135. Primary bit stream portion 
130 includes a primary bit stream 132 for each frame of the video data written to 
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tape 1 00 in successive order. For example, bit stream one of frame one is written 
first. Next, bit stream one of frame two is written. 

Once all of the primary bit stream data has been written onto tape 100, a 
plurality of supplemental bit streams 137 (e.g., one from each video frame) are 
written to supplemental bit stream portion 135 of tape 100. For example, bit 
stream two of frame one is first written into supplemental bit stream portion 1 35. 
Next, bit stream two of frame two is written. This process repeats until every 
supplemental bit stream for all frames have been written. When processing is 
completed for the entire image or sequence of images (as in the case of a movie), 
primary bit sfream portion 130 contains sufficient data for a lossy presentation of 
the original data, and supplemental bit sfream portion 135 contains the additional 
data needed for providing lossless quality data presentations. 

FIG. 2 depicts a system 200 for recording compressed data onto a storage 
medium such as tape 1 00 in accordance with the present invention. An encoder 
21 0 is used for receiving a video image to be compressed. The output of encoder 
210 is aprimary bit sfream 132 and a supplemental bit sfream 137. Bitstream 132 
has a fixed length and contains sufficient data to provide a lossy quality 
presentation of the image or video sequence. Bit sfream 137 has a variable length 
and contains the additional data needed to present the image or video sequence in 
lossless quality. 

To record a frame of video data, primary bit sfream 132 is copied directly 
onto storage medium 1 00. The recording of primary bit stream 1 32 onto storage 
medium 100 is done as the bit stream is received, i.e., in real-time. When 
supplemental bit stream 1 3 7 is received, it is temporarily stored in a memory 23 0 . 
Memory 230 may be a computer hard disk or cache memory, for example. 

As the bit streams for each frame are presented for recording, a frame 
counter 216 is incremented. Frame counter 216 begins with an initial count of 
zero. When processing of a batch of data (e.g., a video sequence) is completed, 
a total number of frames value (F^^^^) is set equal to the value of the frame counter. 
Once all of primary bit sfream 132 has been recorded onto storage medium 100, 
then supplemental bit sfream 1 37 is refrieved from memory 230 and written to the 
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remaining portion of storage medium 100. A person skilled in the art will 
recognize that storage medium 1 00 may become "full" before all of supplemental 
bit stream 137 can be written thereon. Thus, a controller device can be used to 
stop recording if the tape is full. 

In one embodiment of the invention, only one image or frame is processed 
at a time. In this example, the supplemental bit stream is written from memory to 
the storage mediimi as soon as the writing of the primary bit stream is completed. 

In another embodiment, several frames are processed at a time so that the 
supplemental bit sfream for each frame is written onto the storage medium only 
after the primary bit stream for every frame has been encoded and written onto 
storage medium 100. In both of the embodiments discussed, supplemental bit 
stream 137 can be written onto the end of the storage medium 100 in non-real 
time, i.e., after completing the encoding of the image or video sequence. 

During writing of supplemental bit stream 137 to storage medium 100, 
frame counter 216 is used to ensure that writing of supplemental bit stream 137 
has been completed for each frame. To accomplish this, frame counter 216 is 
again set equal to zero. It is then incremented as each frame's supplemental bit 
stream 137 is written to storage medium 100. When Frame counter 216 equals 
the total number of frames value (Ft„^), processing is completed. 

FIGs. 3-5 illustrate decompression and playback of data from storage 
medium 100 in accordance with the present invention. There are two playback 
modes available: preview mode (lossy playback) and best quality mode (lossless 
playback). A person seeking to view an image or video sequence would be 
presented vsdth the option of choosing either. 

FIG. 3 illustrates lossy playback or preview mode. When a lossy quality 
presentation is desired then primary bit stream 132 is retrieved from storage 
medium 1 00 and input into decoder 235. The output from decoder 235 is a video 
image having a quality somewhat less than the original image. 

FIGs. 4 and 5 illustrate presentation of images in a lossless mode. First, 
as shown in FIG. 4, all of the data from supplemental bit sfream 137 is copied 
from storage medium 100 into memory 230. Second, as depicted in FIG. 5, 
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primaiy bit stream 1 32 from storage medium 1 00 and supplemental bit stream 137 
from memory 230 are provided to decoder 235 for decoding together. The output 
from decoder 235 is a video presentation that has a quality exactly the same as the 
image when originally presented. 

FIG. 6 shows a method for performing image compression according to 
the present invention; that is, a method for producing primary bit stream 1 32 and 
supplemental bit stream 137. In a preferred embodiment, method 600 is 
performed by encoder 210. 

Method 600 begins at a step 605. In a step 610, the image to be 
compressed is divided into a plurality of regions. In a step 6 1 1 , a group indicator 
value is initialized. In a step 612, a region indicator value is initialized. In a step 
6 1 5, a pixel sample set comprising a number of pixels from a region within one 
group is selected. The group is identified by the present group indicator value. 

In a step 617, a less significant bit value (L) is determined for the region. 
This value indicates the number of less significant bits within a pixel value. For 
an eight (8) bit pixel value, the number of less significant bits could range from 0 
to 7. In a preferred embodiment, three bits are used to represent the value L. For 
ten (1 0), twelve (1 2), or sixteen (16) bit pixel values, the number of less significant 
bits could range from 0 to 15. In a preferred embodiment, four bits are used to 
represent the value L. 

In a step 620, prediction error calculations are performed using the pixel 
values of the pixel sample set. In a step 625, fixed length tokens and variable 
length tokens are generated for each pixel vwthin the pixel sample set. Steps 620- 
625 are described in greater detail below with reference to FIG. 7. 

In a step 630, a variable length token vector is generated for the region. 
The variable length token vector is comprised of the variable length tokens 
generated in step 625. In a step 635, a fixed length token vector is generated for 
each bit position associated with a pixel value. Each fixed length token vector is 
formed from less significant bits corresponding to the same bit position for each 
of the fixed length tokens of the selected pixels. 
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In a step 637, a deteraiination of whether there are additional regions to 
select from is made. If the region indicator value is less than the plurality of 
regions then there are additional selections to be made. In a step 639, the region 
indicator value is incremented and processing control is returned to step 615. 

In a step 640, a first bit stream is generated for one group. This first bit 
stream is comprised of all the variable length token vectors for each region within 
the group. In a step 645, a second bit stream is generated for the group. This 
second bit stream is comprised of all the fixed length token vectors for each 
region within the group. Steps 630 through 645 are described in greater detail 
with reference to FIG. 9. 

In a step 650, a primary bit stream is generated. This primary bit stream 
is comprised of data from the first bit stream and possibly the second bit stream. 
In a step 655, a supplemental bit stream is generated. This supplemental bit 
stream is comprised of any remaining first bit stream and second bit stream data 
not written into the primary bit stream. Steps 650 and 655 are fiirther described 
with reference to FIG. 10. 

In a step 657, the group indicator value is incremented. At a step 659, a 
determination of whether every pixel in the image has been compressed is made. 
If there are additional pixels to compress then processing control returns to step 
615. 

When processing is completed at a step 660, the primary bit stream 
contains the variable length token vectors for each region within the respective 
groups. The variable length token vectors correspond to the more significant bits 
representing the compressed image or frame. Thus, the data in the primary bit 
stream is sufficient to provide a lossy quality presentation. The supplemental bit 
stream contains the remaining variable length and fixed length token vectors. By 
decoding the data from the primary bit stream and the supplemental bit stream 
together, a lossless quality presentation is obtained. 

FIG. 7 shows steps 620 and 625 for performing prediction error 
computation, mapping, and token generation according to an embodiment of the 
present invention. In this example, the prediction error computation and mapping 
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are performed in accordance with well known Huffman type encoding methods, 
such as Rice encryption. The method begins with the presentation of a pixel 
value in a step 705. The pixel value can be represented by any number of bits 
(e.g., 8, 10, 12, etc.). In a step 710, aprediction error value is calculated for each 
bit according to the following steps. First, prediction error (e) for the first pixel 
in the pixel sample set is defined as e(0) = P(0). Then, the equation e(i)=P(i-l) - 
P(i) is computed, where (i) is an index and e is a prediction error value. The index 
corresponds to the number of pixels selected. For example, where 32 pixel values 
are selected, the index value will range from 1 to 31. Each bit representing the 
pixel value is then set equal to its calculated prediction error value. The calculated 
prediction error value is usually small, therefore, fewer bits can be used to encode 
a series of pixels. Once the prediction errors have been determined they are 
mapped in accordance with the Rice encoding method. Error values from eight- 
bit values have nine bits. Mapping uses the information of the previous error value 
and reduces the error value to eight bits. One of ordinary skill in the art will 
understand the mapping functions thus, further details are not provided. 

In a step 720, the bits less than or equal to the selected (L) value from step 
6 1 7 are identified as the less significant bits of the prediction error. In a step 725, 
the remaining bits are defined to be the more significant bits of the prediction 
error. In a step 730, the less significant bits of the prediction error ^e identified 
as fixed length tokens. In a step 735, all of the more significant bits of the 
prediction error are variable length encoded using an entropy coding routine. 
Entropy coding produces variable length tokens representing the more significant 
bits. The variable length tokens are Huffinan type code words. Method 700 ends 
at a step 740. 

FIG. 8 provides a data flow diagram illustrating the prediction error step 
620 and token generation process step 625 as described in FIG. 7. Here, 
prediction error computation is performed on an 8 bit pixel value 8 1 0 as indicated 
at block 805 . A prediction error value 8 1 5 is calculated for each bit according to 
step 710 described above. Next, the prediction error value is split into more 
significant bits and less significant bits according to a less significant bit value (L) . 
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For eight (8) bit pixel values, the number of less significant bits is three (3). 
Accordingly, the right most number of bits equal to the selected (L) values are 
identified as the less significant bits 825. The remaining bits are defined to be the 
more significant bits 830. Next, more significant bits 830 are variable length 
encoded using an entropy coding routine as indicated at block 835. Entropy 
coding produces variable length tokens 840 representing the more significant bits. 
The less significant bits of the prediction error are designated as fixed length 
tokens 845. 

FIG. 9 further describes the steps 630 and 635 of generating the variable 
length token vectors and fixed length token vectors. In a step 905, a region 
indicator number is initialized. In a step 910, a variable length token vector is 
generated for a region by concatenating the absolute value of the first pixel value 
and the variable length tokens for the remaining pixel values. The variable length 
tokens are arranged in ascending order within the variable length token vector 
based upon their respective pixel bit positions (e.g., Pg to P31). 

In a step 91 8, a fixed length token vector for one region is generated by 
copying one bit of each fixed length token and concatenate those bits into a fixed 
length token vector. There will be a fixed length token vector corresponding to 
each less significant bit position. The remaining steps involve packing the variable 
length token vectors into a first bit stream (bit stream 1 ) and the fixed length token 
vectors into a second bit stream (bit stream 2) m accordance with steps 640 and 
645. 

First, in a step 920, a current bit position value is set equal to the less 
significant number bit value (L) associated with the region. Next, in a step 922, 
the variable length token vector for the region is packed into a first bit stream (bit 
stream 1). In a step 923, a determination is made of whether the variable length 
token vector packing process has been completed for each region. If not, then in 
a step 924, the region indicator number is incremented and control is returned to 
step 910. When the resuh of determination step 923 is yes, the variable length 
token vectors for each region will have been arranged in ascending order within 
bit stream 1 based upon their respective region, (e.g., R^, to R„^. 
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In a step 925, the region indicator number is initialized again. Beginning 
with the region corresponding to the region indicator number, in a step 926, a 
determination is made of whether the region has a fixed length token vector 
corresponding to the current bit position value. If the result is yes, then in a step 
927, the fixed length token vector from that region is copied into bit stream 2. 
In a step 928, a determination of whether all the regions have been checked is 
made. If the region indicator number is equal to the plurality of regions then all 
the regions have been checked. If there are additional regions to check then at a 
step 929, the region indicator number is incremented and processing is returned 
to step 926. 

In a step 930, the current bit position value is set equal to the current bit 
position value minus one. In a step 93 5, a determination of whether the current 
bit position value equals zero is made. If it does not then processing is returned 
to step 925. When processing ends at a step 940, bit stream 1 has been generated 
and contains all the variable length token vectors for each region within a 
particular group. Likewise, bit stream 2 has been generated and contains all of the 
fixed length token vectors for each region within the same group. 

FIG. 10 describes the steps 650 and 655 for generation of a primary and 
possibly supplemental bit stream according to the present invention. The primary 
bit stream is comprised of segments having a fixed length. In a step 1008, the 
maximum size of each groups segment (N) is defined. The size of the group 
segment is dependent upon the bandv^ddth limitations imposed by the storage 
media used to store the compressed data. 

In a step 1 01 5, N bits are retrieved fi*om bit stream 1 and bit stream 2 and 
copied into the group allocated segment within the primary bit stream. In a step 
1 020, a determination of whether additional data remains to be copied is made. If 
the value N is less than the combined length of bit stream 1 and bit stream 2, then 
there will be additional data to copy. 

The supplemental bit stream can be expanded to any length necessary to 
hold the remaining data from bit streams 1 and 2. Thus, the supplemental bit 
stream will have a variable length. If additional data needs to be copied then in a 
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step 1025, the remaining portions of bit stream 1 and/or bit stream 2 are written 
into a supplemental bit stream. Next, in a step 1027, the end of the supplemental 
bit stream is padded with bits so that the length of the group' s segment within the 
supplemental bit stream is equal to 1 byte. In a step 1 030, each group's segment 
length within the supplemental bit stream is determined and appended to the 
header portion of the supplemental bit stream. The group segment length value 
can be determined by subtracting (N) from the combined length of bit steam 1 and 
bit stream 2. In the case where no additional data was copied, the group segment 
length value would be equal to zero. The group segment length values are useful 
for providing random or arbitrary access to the respective group portions of the 
supplemental bit stream. This ability to access the data is this manner makes 
parallizing possible. When processing is completed at a step 1 040, the primary bit 
stream, and if generated, the supplemental bit stream, will contain data 
corresponding to each group identified during the compression process. 

The maximum number of groups to be identified is dependant upon the 
type of image fi-ame being compressed. For example, a standard definition NTSC 
video fi-ame has (720 X 487 pixels). If 32 pixel values are taken fi-om 4 regions, 
the maximum number of groups for the image would be: 

Gmax=720*487*3 (color components) / (4*32)=8218.12 or 8,219 groups. 

In another example, an HDTV video frame has (1920 X 1080 pixels). If 
32 pixel values are taken from 4 regions, the maximum number of groups for the 
image would be: 

Gmax= 1920* 1080*3/(4*32)^48,600 groups. 

An example application of the above described method will now be 
discussed with respect to FIG. 11. An image 1105 having three (3) color 
components (e.g., Red, Green, and Blue) per pixel has been presented for 
compression. There are eight (8) bits used to represent each color component. 
One color component is processed at atime. The input image 1 1 05 is divided into 
a plurality of regions 1110. For purpose of illustration, regions 1 1 1 OA-1 1 1 OD are 
depicted, (also referred to as regions r^-rj) From each of these regions, a pixel 
sample set 1 1 1 1 is selected by choosing aplurality of adjacent pixels for encoding. 
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The pixel sample sets 1 1 1 1 A-1 1 1 ID can be selected from anywhere within the 
respective regions. In a preferred embodiment, a symmetrical selection routine is 
used. Accordingly, beginning with the first region lllOA, a pixel sample set 
1 1 1 1 A is selected from the fourth row. In a preferred embodiment, 32 adjacent 
pixels are selected. Next, from the second region 111 OB, a pixel sample set 
1 1 1 IB is selected from an offset of the first region 1 11 OA. The offset can be four 
rows for example. The goal is to obtain a representative sample of the whole 
image. From the third region 1 1 IOC, a pixel sample set 11 IIC is selected from 
row twelve (12). Finally, pixel set 11 1 ID is selected from row sixteen (16) of 
region 1 1 1 OD. Selection of pixel sample sets for a next group will begin on the 
next row of each respective region. When the last row of a region has been 
reached, the next pixel sample set selection is made from the top of the region and 
continues down until all pixels have been processed. 

The encoding routine is performed for this first group as described in steps 
7 1 0-73 5 and produces a bit sfream corresponding to each respective region. For 
example, by inputting four 32 pixel value sets 1 1 1 1 A, 1 1 11 B, 1 1 1 1 C, and 1 1 11 D, 
the output would be four encoded bit streams 1 1 15A-1 1 15D corresponding to 
Region 0 through Region 3 (R0-R3). 

As shown, each bit stream 1 1 1 5A-1 1 1 5D has a header portion indicating 
the number of less significant bits represented within the bit sfream. The bit 
streams fiirther include the absolute value of the first pixel value in the set (PO) 
and tokens representing the calculated prediction error values for pixel values one 
(P 1 ) through thirty-one (P3 1 ). The tokens are designated as either variable length 
11 17 or fixed length 1118. 

Each of the four bit streams 1 1 1 5A-1 1 1 5D resulting from the encoding 
process are rearranged and combined to produce a single bit sfream 1119 
according to the routine described in steps 905-93 5. Bit stream 1 1 1 9 is comprised 
of two portions. The first portion 1 1 20 contains the variable length token vectors 
corresponding to the variable length tokens 1117. The second portion 1122 
contains specially arranged fixed length token vectors corresponding to the fixed 
length tokens 1118. The fixed length token arranging scheme is fiirther described 
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with respect to FIG. 12. A primary bit stream 1 1 30 is comprised of data from the 
first portion 1120 and the second portion 1122 of bit stream 1119. A 
supplemental bit stream 1135 is comprised of the remaining data from the second 
portion 1 122 of bit stream 1119. Primary bit stream 1 1 30 has sufficient data to 
provide a lossy quality presentation. Similarly, primary bit stream 1130 and 
supplemental bit stream 1135 taken together can be decoded to provide a lossless 
quality presentation. 

FIG. 12 provides a data flow diagram for the reordering of the second 
portion 1 122 of bit stream 1119 according to the present invention. Data from the 
regions 1 1 15A-1 1 15D is depicted. In block 1212, a fixed length token vector 
1 2 1 5 is generated for each region 1 1 1 5 by concatenating the fixed length tokens 
1 1 1 8 for each pixel bit (P 1) - (P3 1). Each region has a fixed length token vector 
1215 corresponding to each less significant bit position. 

To pack the fixed length token vectors, a current bit position value is set 
equal to the highest value (L) associated with each region within a group as 
described in step 920 of FIG. 9. Here, the current bit position value equals four. 
Next, as described in step 925, beginning with the first region 1115A, a 
determination is made of whether the region has a fixed length token vector 1215 
corresponding to the current bit position value. If the result is yes, then as 
referenced in step 927, the fixed length token vector from that region is copied 
into the second bit stream. The above steps are repeated for the next region until 
all of the regions have been considered. In this case, the first vector 
corresponding to current bit position value is found in the second region 1 1 1 5B 
(fixed length token vector 121 5A). This vector is combined with any other 
corresponding vectors (in this case there are none) to produce combined vector 
1216. Combined vector 1216 is written into the fixed length portion 1 122 of bit 
stream 1119. Next, the cvirrent bit position is set equal to the current bit position 
value minus one. The above fixed length token vector packing process is repeated 
until the current bit position value equals zero. Thus, combined vectors 1218, 
1220 and 1 222 are generated. Combined vector 1 2 1 8 is comprised of fixed length 
token vectors 1215B and 1215C. Combined vector 1220 is comprised of fixed 
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length token vectors 1 2 1 5D- 1 2 1 5F. Combined vector 1 222 is comprised of fixed 
length token vectors 1 2 1 5 G- 1 2 1 5 J. 

While various embodiments of the present invention have been described 
above it should be understood that they have been presented by way of example 
5 and not limitation. It will be apparent to persons skilled in the relevant arts that 

various changes in form and detail can be made therein without departing from the 
spirit and scope of the invention. Thus, the present invention should not be limited 
by any of the above described exemplary embodiments but should be defined only 
in accordance with the following claims and their equivalents. 
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1 . A method for recording data onto a storage mediiun, comprising 
the steps of: 

(a) receiving a plurality of primary bit streams of fixed 
length and a plurality of supplemental bit streams of variable length from a codec, 
said plurality of primary bit streams and said plurality of supplemental bit streams 
representing data to be recorded onto the storage medium; 

(b) recording each of said plurality of primary bit 
streams onto the storage medium; 

(c) storing each of said plurality of supplemental bit 
streams in a temporary memory location; and 

(d) after said plurality of primary bit streams have been 
recorded onto the storage medium, retrieving said plurality of supplemental bit 
streams from said temporary memory location and recording said supplemental bit 
streams onto the storage medium. 

2. The method of claim 1 wherein said plurality of primary bit 
streams are recorded onto the storage medium in real time as they are received 
from said codec and wherein said plurality of supplemental bit streams are 
recorded onto the storage medium in a non-real time marmer after recording of 
said plurality of primary bit streams. 

3. The method of claim 1 wherein a progressive lossless codec 
generates said plurality of primary bit streams of fixed length and said plurality of 
supplemental bit streams of variable length. 

4. The method of claim 3 wherein said plurality of primary bit 
streams and said plurality of supplemental bit streams are generated from image 
data. 
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5. The method of claim 3 wherein said plurality of primary bit 
streams and said plurality of supplemental bit streams are generated from high 
definition image data. 

6. The method of claim 1 wherein the storage medium is a high 
definition tape. 

7. The method of clam 1 wherein the storage medium is a hard disk 

array. 

8. A method for providing selectable quality presentation of 
compressed data stored on a storage medium, comprising the steps of: 

(a) determining a desired data presentation quahty 
level; 

(b) if said desired data presentation quality level is 
lossy, then 

(i) retrieving a primary portion of the 
compressed data from the storage mediimi, 
and 

(ii) decoding said primary portion of the 
compressed data; 

(c) if said desired data presentation quality level is 
lossless, then 

(i) retrieving said primary portion and a 
supplemental portion of the compressed 
data from the storage medium, and 

(ii) decoding said primary and supplemental 
portions of the compressed data; and 

(d) presenting said decoded data. 
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9. The method of claim 8, wherein said primary portion of the 
compressed data comprises variable length token vectors or a combination of 
variable length token vectors and fixed length token vectors. 

1 0. The method of claim 9, wherein said supplemental portion of the 
5 compressed data comprises fixed length token vectors, a combination of fixed 

length token vectors and variable length token vectors, or nothing at all. 



1 1 . The method of claim 10, further comprising the step of: 
transferring said variable length compressed data to a temporary memory location 
prior to said step of decoding said primary and supplemental portions of the 
10 compressed data. 



12. A data storage product comprising a machine readable medium 
having stored thereon compressed data in a progressive lossless format that 
facilitates selective data presentation with either lossy quality or lossless quality. 

13. The data storage product of claim 12 wherein said compressed 
15 data comprises header data, variable length data, and fixed length data. 

14. The data storage product of claim 12 wherein said machine 
readable medium is a high definition tape. 

1 5 . The data storage product of claim 1 2 wherein said machine 
readable medium is a hard disk array. 

20 1 6. A data compression system for recording data onto storage media, 

comprising: 

(a) a codec for generating a plurality of primary bit 
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streams of fixed length and a plurality of supplemental bit streams of variable 
length, said plurality of primary and supplemental bit streams representing data to 
be recorded onto the storage media; 

(b) means for receiving said generated plurality of 
5 primary bit streams and said plurality of supplemental bit streams; 

(c) memory for storing each of said plurality of 
supplemental bit streams; and 

(d) means for recording onto the storage media each 

of said plurality of primary bit streams and said plurality of supplemental bit 
10 streams. 

1 7. The data compression system of claim 1 6 wherein said codec is a 
progressive lossless codec. 

18. A system for providing selectable quality presentation of 
compressed data stored on a storage medium, comprising: 

1 5 (a) means for determining a desired data presentation 

quality level; 

(b) means for retrieving a primary portion of the 
compressed data and a supplemental portion of the compressed data from the 
storage medium; and 

20 (c) means for decoding said primary portion and said 

supplemental portion of the compressed data to facilitate selective data 
presentation with either lossy quality or lossless quality. 

1 9. The method of claim 1 8 wherein said means for decoding said 
primary portion and said supplemental portion of the compressed data to facilitate 

25 selective data presentation with either lossy quality or lossless quality is a 

progressive lossless codec. 
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System and Method for Storing Compressed 
Data Onto a Storage Medium 

A system and method for recording compressed data onto a storage 
medium so that it can be presented later in either lossy or lossless quality. The 
method receives a plurality of primary bit streams and supplemental bit streams 
representing data to be recorded onto the storage medium. Each primary bit 
stream is recorded onto the storage medium as it is received. As each of the 
supplemental bit streams are received, they are stored in a temporary memory 
location. After the primary bit streams have been recorded onto the storage 
medium, the supplemental bit streams are retrieved from the temporary memory 
location and recorded onto the storage medium. The recording process is 
completed when all the primary bit stream data and the supplemental bit stream 
data have been written onto the storage medium. To present the data, a user is 
given the option of viewing the data in either lossy quality or lossless quality. If 
lossy quality is selected, then the primary bit stream is retrieved from the storage 
medium and decoded. If lossless quality is selected, then the supplemental bit 
stream is retrieved from the storage mediimi and copied in a temporary memory 
location. Once this step is completed, the primary bit stream and the supplemental 
bit stream are decoded together. 
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